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5 BACKGROUND OF THE INVENTION 

A. Field of the Invention 

The present invention is related to a method and system for providing 
communication services over a network. In particular, the present invention relates to a 
system and method for exchanging data related to personal information device (PID) 
10 services over a telephony network. 

B. Description of the Related Art 

For many years, telephone service providers on the Public Switched Telephone 
Network (PSTN) provided their customers nothing more than a telephone line to use to 
communicate with other subscribers. Over time, telephone service providers have 
15 enhanced their service by providing Custom Local Area Signaling Service (CLASS) 
features to their customers. Similar communication services are provided by a Private 
Branch Exchange (PBX), which is typically implemented in a nonresidential setting. 

The CLASS features permit customer subscribers of the features to tailor their 
telephone service according to individual needs. Some of the more popular CLASS 
20 features are: 

• Call blocking: The customer may specify one or more numbers from which he 
or she does not want to receive calls. A blocked caller will hear a rejection message, 
while the callee will not receive any indication of the call. 

• Call return: Returns a call to the most recent caller. If the most recent caller is 
25 busy, the returned call may be queued until it can be completed. 

• Call trace: Allows a customer to trigger a trace of the number of the most 
recent caller. 

• Caller ID: The caller's number is automatically displayed during the silence 
period after the first ring. This feature requires the customer's line to be equipped with a 

30 device to read and display the out-of-band signal containing the number. 
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• Caller ID blocking: Allows a caller to block the display of their number in a 

callee's caller ID device. 

• Priority ringing: Allows a customer to specify a list of numbers for which, 
when the customer is called by one of the numbers, the customer will hear a distinctive 

5 ring. 

• Call forwarding: A customer may cause incoming calls to be automatically 
forwarded to another number for a period of time. 

A customer subscriber to a CLASS feature may typically activate and/or de- 
activate a CLASS feature using "*" directives (e.g., *69 to automatically return a call to 
10 the most recent caller). CLASS features may also be implemented with the use of out-of- 
band data. CLASS feature data is typically transmitted between local Class-5 switches 
using the Signaling System #7 (SS7). 

Local Exchange Carriers (LECs) and other similar organizations maintain CLASS 
offices that typically contain a database entry for each customer. The database allows 
5 specification of the CLASS features a customer has subscribed to, as well as information, 
such as lists of phone numbers, associated with those features. In some cases, customers 
may edit these lists on-line via a touch-tone interface. A list of all phone numbers that 
have originated or terminated a call with each customer is often included in the CLASS 
office database. For each customer, usually only the most recent number on this list is 
20 stored by the local Class-5 switch. 

A Private Branch Exchange (PBX), is a stored program switch similar to a Class- 
5 switch. It is usually used within a medium-to- large-sized business for employee 
telephony service. Since a PBX is typically operated by a single private organization, 
there exists a wide variety of PBX services and features. Custom configurations are 
25 common, such as integration with intercom and voice mail systems. PBX's typically 

support their own versions of the CLASS features, as well as other features in addition to 
those of CLASS. Most PBX features are designed to facilitate business and group 
communications. 

A summary of typical PBX features includes: 
30 • Call transfer: An established call may be transferred from one number to another 
number on the same PBX. 
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• Call forwarding: In addition to CLASS call forwarding, a PBX number can be 
programmed to automatically transfer a call to another number when the first number 
does not answer or is busy. 

• Camp-on queuing: Similar to PSTN call return, a call to a busy number can be queued 
5 until the callee can accept it. The caller can hang up their phone and the PBX will ring 

them when the callee answers. 

• Conference calling: Two or more parties can be connected to one another by dialing 
into a conference bridge number. 

• Call parking: An established call at one number can be put on hold and then 

10 reestablished from another number. This is useful when call transfer is not warranted. 

• Executive override: A privileged individual can break into an established call. After a 
warning tone to the two participants, the call becomes a three-way call. 

While the CLASS and PBX features have enhanced the offerings of service 
providers that use the PSTN, the features are nevertheless limited in their flexibility and 

15 scope. The effect to the user is that the features become clumsy and difficult to use. For 
example, in order to use the Call Forwarding function, the user must perform the steps at 
the user's own phone prior to moving to the location of the telephone to which calls will 
be forwarded. A more desirable approach, from the standpoint of usefulness to the user, 
would be to perform the steps at the telephone to which calls will be forwarded. 

20 Much of the lack of flexibility of the PSTN features is due to the lack of 

flexibility in the PSTN system itself. One problem with the PSTN is that the terminal 
devices (e.g. telephones) lack intelligence and operate as *'dumb" terminals on a network 
having the intelligence in central offices. Most PSTN telephones are limited in functional 
capability to converting the analog signals they receive to sound and converting the 

25 sound from the handset to analog signals. 

Some PSTN telephones have a display device and a display function to display 
specific information communicated from intelligent agents in the PSTN network using 
the PSTN signaling architecture. For example, some PSTN telephones have a display 
function to enable the Caller ID feature. Even such PSTN telephones are limited however 

30 by the closed PSTN signaling architecture, which prohibits access by the PSTN 
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telephones to the network signaling protocols. The display functions are effectively 
limited to displaying text, again, as a "dumb" terminal. 

The Internet presents a possible solution for distributing intelligence to telephony 
terminal devices. In Internet telephony, digitized voice is treated as data and transmitted 

5 across a digital data network between a telephone calls' participants. One form of 
Internet telephony uses a telephony gateway/terminal where EP telephony calls are 
terminated on the network. PSTN telephones are connected by a subscriber line to the 
gateway/terminal at the local exchange, or at the nearest central office. This form of 
Internet telephony provides substantial cost savings for users. Because the PSTN portion 

10 used in Internet telephony calls is limited to the local lines on each end of the call, long 
distance calls may be made for essentially the cost of a local call. Notwithstanding the 
costs savings provided by this form of Internet telephony, it is no more flexible than the 
PSTN with respect to providing enhancements and features to the basic telephone 
service. 

15 In another form of Internet telephony, telephones are connected to access 

networks that access the Internet using a router. The telephones in this form of Internet 
telephony may be substantially more intelligent than typical PSTN telephones. For 
example, such a telephone may include substantially the computer resources of a typical 
personal computer. 

20 Data network telephones and the data network (e.g. Internet) system in which they 

operate, however, lack a substantial infrastructure and service providers for providing 
telephone service. 

It would be desirable to incorporate CLASS and PBX features into a data network 
telephony system that uses a data network such as the Internet. 
25 It would be desirable to provide new features and enhancements to telephony 

service that accommodates and conforms to users 1 needs. 

It would also be desirable to provide features and capabilities to telephone service 
that create new opportunities for users and for service providers. 

The present invention addresses the above needs by providing a system in a data 
30 network telephony system, such as for example, the Internet, that enables connected users 
to transmit user data, such as graphical data, or application-related data (e.g. email, 
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contacts data, calendar data, interactive game data, etc.), to each other across a telephony 
network using PEDs (Portable Information Devices) that may be linked to network 
communication devices. The system according to some embodiments of the present 
invention addresses concurrent voice and user data transmissions between users. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Presently preferred embodiments of the invention are described below in 
conjunction with the appended drawing figures, wherein like reference numerals refer to 
like elements in the various figures, and wherein: 
5 FIG. 1 is block diagram of a network telephony system according to one 

embodiment of the present invention; 

FIG. 2 is a block diagram showing a system for exchanging data related to 
portable information device (PID) services on a telephony system according to an 
exemplary embodiment of the present invention; 
10 FIG. 3 is a block diagram of a data network telephone according to an exemplary 

embodiment of the present invention; 

FIG. 4 is a block diagram of a PID according to an exemplary embodiment of the 
present invention; 

FIG. 5 is a stack layer diagram showing the layers of an IrDA stack; 
15 . FIG. 6 is a block and stack layer diagram illustrating an embodiment of the 

protocol stacks in an exemplary embodiment of a PID linked to a data network telephone; 

FIG. 7 is block and stack layer diagram illustrating an embodiment of the present 
invention in which a SIP call may be established; 

FIG. 8 is a combined block and pictorial diagram showing a system for providing 
20 PID data exchange according to a first embodiment of the present invention; 

FIG. 9 is a combined block and pictorial diagram showing a system for providing 
PH> data exchange according to a second embodiment of the present invention; and 

FIG. 10 is a combined block and pictorial diagram showing a system for 
providing PID data exchange according to a third embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The following references to patent applications filed concurrently herewith are 
incorporated be reference: 

* "System and Method for Controlling Telephone Service Using a Wireless 
5 Personal Information Device" to Schuster, et al. 

* "System and Method for Advertising Using Data Network Telephone 
Connections" to Schuster, et al. 

* "System and Method for Providing User-Configured Telephone Service in a Data 
Network Telephony System" to Sidhu, et al. 

10 * "System and Method for Accessing a Network Server Using a Portable 

Information Device Through a Network Based Telecommunication System" to 
Schuster, et al. 

* "System and Method for Enabling Encryption on a Telephony Network" to 
Schuster, et al. 

15 * "System and Method for Using a Portable Information Device to Establish a 
Conference Call on a Telephony Network" to Schuster, et al. 

* "System and Method for Associating Notes with a Portable Information Device 
on a Network Telephony Call" to Schuster, et al. 

* "System and Method for Providing Shared Workspace Services Over a Telephony 
20 Network" to Schuster, et al. 

* "System and Method for Providing Service Provider Configurations for 
Telephones in a Data Network Telephony System" to Schuster, et al. 

The following additional references are also incorporated by reference herein: 

* "Multiple ISP Support for Data Over Cable Networks" to Ali Akgun, et al. 

25 * "Method and System for Provisioning Network Addresses in a Data-Over-Cable 
System" to Ali Akgun, et al., Serial No. 09/218,793. 

* "Network Access Methods, Including Direct Wireless to Internet Access" to 
Yingchun Xu, et al., Serial No. 08/887,313 



30 
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A. PID-Enabled Data Network Telephony System 

FIG. 1 is a block diagram showing an exemplary embodiment of a system 100 for 
exchanging mixed media messages according to one embodiment of the present 
invention. The system includes a data network 106. A first voice communication device 
5 1 08a linked to a first access network 1 12 via connection 130 may communicate over the 
data network 106 by connecting via the first access network 1 12. A second voice 
communication device 108b is linked to a second access network 1 14 through connection 
136 and may communicate over the data network 106 by connecting via the second 
access network 114 

10 The data network 1 06 in the system 100 typically includes one or more Local 

Area Networks (LANs) connected to one another or to a Wide-Area Network (WAN), 
such as an Internet Protocol (IP) network, to provide wide-scale data connectivity. The 
data network 106 may use Voice Over Packet (VOP) schemes in which voice signals are 
carried in data packets. The network 106 may also include a connection to the Public 

15 Switched Telephone Network (PSTN) to allow for voice connections using traditional 
circuit switching techniques. In one embodiment, the data network 106 may include one 
or more LANs such as Ethernet LANs and support data transport protocols for 
performing Voice-over-Internet-Protocol (VoIP) techniques on the Internet. For further 
details regarding VoIP, see the information available through the Internet Engineering 

20 Task Force (IETF) at www.ietf.org . In addition, an Internet Telephony gateway may be 
included within the system 100 to allow for voice connections to users connected by 
subscriber lines at a PSTN Central Office. 

The voice communication devices 108a-b (described further below with reference 
to FIG. 3) typically include a voice input, a voice output and a voice processing system. 

25 The voice processing system converts voice sound to digital data signals that are 
communicated on a voice connection over the data network. The voice processing 
system also converts digital data signals received from the voice connection to voice 
sound. The voice communication devices 108a-b typically include a central processing 
unit and memory to store and process computer programs. Additionally, each voice 

30 communication device 108a-b typically includes a unique network address, such as an IP 
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, address, in memory to uniquely identify it to the data network 106 and to permit data 
packets to be routed to the device. 

A first PID 1 10a linked to the first voice communication device 108a via 
connection 109a may communicate over the data network 106 by connecting via the first 

5 access network 1 12. A second PID 1 10b linked to the second voice communication 
device 108b via connection 109b may communicate over the data network 106 by 
connecting via the second access network 114. The PIDs 1 lOa-b each contain user 
attributes stored in a user information data base. The user attributes may contain such 
information as a user identifier, schedule information, and other information that is 

10 associated with a user of the PID 1 10a or 1 10b. The PIDS 1 lOa-b each include a user 
interface allowing a user to easily enter and retrieve data. In a preferred embodiment, the 
user interface includes a pressure-sensitive display that allows a user to enter input with a 
stylus or other device. An example of a PID with such an interace is a PDA (Personal 
Digital Assistant), such as one of the Palm™ series of PDAs offered by 3Com® 

15 Corporation. The PIDs 1 lOa-b may include other functionality, such as wireless phone or 
two-way radio functionality. 

Links 109a-b are point-to-point links, and may entirely or partially wireless, or 
they may be hard-wired connections. Each of the links 109a-b is preferably a wireless 
link, such as an infrared link specified by the Infrared Data Association (IrDA) (see 

20 irda.org for further information) or a radio frequency (RF) link such as the Bluetooth 
system (see www.bluetoothxom for further information). However, the point-to-point 
link can also be a hardwired connection, such as an RS-232 serial port. 

In one embodiment, the voice communication device 108a includes a handset 
with a receiver and transmitter similar or identical to handsets of traditional circuit- 

25 switched telephones. A console on which the handset sits may include the voice 
processing system, a display 1 16, and a keypad 118. 

In a preferred embodiment, a portion of the voice communication device 108a 
utilizes an NBX 100™ communication system phone offered by 3Com® Corporation. In 
alternative embodiments, the voice communication device 108a may include any device 

30 having voice communications capabilities. For example, a personal computer having a 
microphone input and speaker output may also be used to implement the voice 
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communication device 108a, Other configurations are also intended to be within the 
scope of the present invention. 

The details relating to operation of the voice communication devices 108a and 
108b depend on the nature of the data network 106 and the nature of the access networks 

5 112, 1 14 connecting the voice communication devices 108a and 1 08b to each other 

and/or to other network entities. The access networks 1 12, 1 14 typically include any high 
bandwidth network adapted for data communications, i.e. a network having greater than 
64,000 bits-per-second (bps) bandwidth. The access networks 112, 114 may link to the 
voice communication devices 108a-b using an Ethernet LAN, a token ring LAN, a 

10 coaxial cable link {e.g. CATV adapted for digital communication), a digital subscriber 
line (DSL), twisted pair cable, fiberoptic cable, an integrated services digital network 
(ISDN) link, and wireless links. In embodiments that may not require bandwidth greater 
than 64,000 bps, the access networks 1 12, 1 14 may also include the PSTN and link the 
voice communications devices 108a-b by an analog modem. Further details regarding 

15 specific implementations are described below, with reference to FIGs. 2 through 10. 

B. System for Providing PID Data Exchange Using a Data Network 
Telephony System 

One advantage of the PDA-Enabled Data Network Telephony System 100 in FIG. 
1 is that it may be used to exchange PID data. In one embodiment, the PIDs 1 10a is able 

20 to accept and process PID data from a user through a user interface on the PID 1 10a. The 
PID data may include any data used by the PID, such as graphical data, email, calendar 
data, contacts data (e.g. business card data), interactive game data. The PID data can be 
communicated across the link 109a to the voice communication devices 108a for 
transport across the first access network 112, the data network 106, and the second access 

25 network 1 14 to the voice communication device 1 08b. The PID 1 1 0b can receive the 

PID data across the link 109b for display on the PID 1 10b. A voice-over-data channel for 
communicating voice-over-data can concurrently exist with this communication of PID 
data over a graphical data channel. In this way, a user of the PID 1 1 0a can communicate 
PED data to a user of the PID 1 10b while voice signals are communicated between the 

30 voice communication device 108a and the voice communication device 108b. 
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1 . Local Area Network As An Exemplary Access Network 

FIG. 2 is a block diagram showing one example of the system 100 of FIG. 1 for 
providing PID data exchange according to the present invention. The system 200 in FIG. 
2 includes a local area network 212, connected to a data network 206 by a first router 

5 228. A cable network 214 is connected to the data network 206 by a second router 238. 
. Those of ordinary skill in the art will appreciate that while FIG. 2 illustrates the access 
networks as the local area network 212 and the cable network 214, any other type of 
network may be used. For example, the local area network 212 and/or the cable network 
214 may be replaced by ISDN, DSL, or any other high-speed data link. 

10 The local area network 212 provides data connectivity to its network elements, 

such as a first data network telephone 208 a, a second data network telephone 208b, and a 
first network telephony connection server 150. The local area network 212 in FIG. 2 is 
an Ethernet LAN operating according to the IEEE 802.3 specification, which is 
incorporated by reference herein, however, any other type of local area network may be 

15 used. The local area network 2 1 2 uses the router 228 to provide the data network 

telephone 208a and the first network telephony connection server 150 with access to the 
data network 206. For example, the router 228 may perform routing functions using 
protocol stacks that include the Internet Protocol and other protocols for communicating 
on the Internet. 

20 The first network telephony connection server 1 50 provides telephony 

registration, location and session initiation services for voice connections in which its 
members are a party. A user may register for telephony service with an administrator of 
the first network telephony connection server 150 and receive a user identifier and a 
telephone identifier. The user identifier and telephone identifier may be sequences of 

25 unique alphanumeric elements that callers use to direct voice connections to the user. 
The first network telephony connection server 150 registers users by storing user records 
in a first registration database 152 in response to registration requests made by the user. 

The call setup process and the user and telephone identifiers preferably conform 
to requirements defined in a call management protocol. The call management protocol is 

30 used to permit a caller anywhere on the data network to connect to the user identified by 
the user identifier in a data network telephone call. A data network telephone call 

12 
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includes a call setup process and a voice exchange process. The call setup process 
includes steps and message exchanges that a caller and callee perform to establish the 
telephone call. The actual exchange of voice signals is performed by a data 
communications channel. The data communications channel incorporates other data 

5 transport and data formatting protocols, and preferably includes well-known data 
communications channels typically established over the Internet. 

The call management protocol used in FIG. 2 is the Session Initiation Protocol 
(SIP), which is described in M. Handley et al., "SIP: Session Initiation Protocol," IETF 
RFC 2543, Mar. 1999, incorporated by reference herein, however, any other such 

10 protocol may be used. Other protocols include H.323, the Media Gateway Control 
Protocol (MGCP), MEGACO, etc. 

The network telephony connection server 1 50 may be used to provide telephony 
service for mobile users. A user may be registered to use the first network telephone 
208a (which is identified by its telephone identifier), but move to a location near the 

15 second network telephone 208b. The user may re-register as the user of the second 
network telephone 208b. Calls that identify the user by the user's user identifier may 
reach the user at the second network telephone 208b. 

2. Cable Network As An Exemplary Access Network 

The system 200 in FIG. 2 also shows a cable network 214 connected to the data 
20 network 206 by a router 238. The cable network 214 provides data network access to its 
network elements, which in FIG. 2 include a third data network telephone 21 8a and a 
second network telephony connection server 162. The users of the data network 
telephone 218a connected to the cable network 214 may communicate over the data 
network 206 with the users of the data network telephones 208a~b connected to the local 
25 area network 212. 

The cable network 214 includes any digital cable television system that provides 
data connectivity. In the cable network 214, data is communicated by radio frequency in 
a high-frequency coaxial cable. The cable network 214 may include a head-end, or a 
central termination system that permits management of the cable connections to the users. 
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3. Providing Telephony Services 

The second network telephony connection server 162 is preferably a SIP-bascd 
server that performs call initiation, maintenance and teardown for the data network 
telephone 218a connected to the cable network 214. The second network telephony 

5 connection server 162 may be similar or identical to the first network telephony 
connection server 150 connected to the local area network 212. 

The system 200 shown in FIG. 2 permits the data network telephones 208a-b 
connected to the local area network 212 to communicate with the data network telephone 
218a connected to the cable network 214. The system shown in FIG. 2 uses SIP in order 

10 to establish, maintain, and teardown telephone calls between users. 

There are two major architectural elements to SIP: the user agent (UA) and the 
network server. The UA resides at the SIP end stations, (e.g. the data network 
telephones), and contains two parts: a user agent client (UAC), which is responsible for 
issuing SEP requests, and a user agent server (UAS), which responds to such requests. 

15 There are three different network server types: a redirect server, a proxy server, and a 
registrar. The various network server types may be combined into a single server, such 
as the network telephony connection server 150 and 162. Not all server types are 
required to implement the embodiments of the present invention. The communication 
services to be provided will determine which servers are present in the communication 

20 system. Preferred embodiments of the present invention may be carried out using proxy 
servers. 

One example of a SIP operation involves a SIP UAC issuing a request, a SIP 
proxy server acting as end-user location discovery agent, and a SIP UAS accepting the 
call. A successful SEP invitation consists of two requests: INVITE followed by ACK. 

25 The INVITE message contains a user identifier to identify the callee, a caller user 
identifier to identify the caller, and a session description that informs the called party 
what type of media the caller can accept and where it wishes the media data to be sent. 
User identifiers in SIP requests are known as SIP addresses. SEP addresses are referred to 
as SIP Uniform Resource Locators (SIP-URLs), which are of the form 

30 sip:user@host.domain. Other addressing conventions may also be used. 
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Redirect servers process an INVITE message by sending back the SIP-URL 
where the callee is reachable. Proxy servers perform application layer routing of the SEP 
requests and responses. A proxy server can either be statefiil or stateless. A stateful 
proxy holds information about the call during the entire time the call is up, while a 
5 stateless proxy processes a message without saving information contained in the message. 
Furthermore, proxies can be either forking or non- forking. A forking proxy can, for 
example, ring several data network telephones at once until somebody takes the call. 
Registrar servers are used to record the SIP address (the SIP URL) and the associated IP 
address. The most common use of a registrar server is for the UAC to notify the registrar 

10 where a particular SIP URL can be reached for a specified amount of time. When an 
INVITE request arrives for the SIP URL used in a REGISTER message, the proxy or 
redirect server forwards the request correctly. 

At the local area network 212, the central registrar/proxy server, such as the first 
network telephony server 150, is the primary destination of all SIP messages trying to 

15 establish a connection with users on the local area network 212. Preferably, the first 
network telephony server 150 is also the only destination advertised to the SIP clients 
outside the LAN 212 on behalf of all the SEP clients residing on the LAN 212. The 
network telephony server 150 relays all SIP INVITE messages to the appropriate final 
destination (or another SIP proxy), based on a database lookup using the first SEP 

20 database 152. It allows all mobile clients to register with their current locations. 

Similarly, the second network telephony server 162 is the primary destination of 
all SIP messages trying to establish a connection with the data network telephone 218a 
connected to the cable network 214. Preferably, the second network telephony server 
162 is also the only destination advertised to the SIP clients outside the cable network 

25 214 on behalf of all the SIP clients (e.g. data network telephones) residing on the cable 
network 214. The second network telephony server 162 relays all SIP INVITE messages 
to the appropriate final destination (or another SIP proxy), based on a database lookup 
using the second SEP database 164. 

The data network telephones 208a-b and 218a in the system 200 preferably have 

30 pre-programmed device identifiers (e.g. phone numbers), represented as S IP-URL's that 
are of the form sip: user@domain. An example is sip: 847555I212@3Com.com.. After 
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power-up, each of the data network telephones 208a-b and 218a sends a SIP REGISTER 
message to the default registrar, such as the network telephony servers 150 and 162. 
When a call arrives at one of the network telephony servers 150 or 162 for any of the 
registered SIP URLs, the server will forward the call to the appropriate destination. If a 
data network telephone is moved to a new location, all calls to the associated SIP URL 
will still be properly routed to that device. In other words, the system in FIG. 2 provides 
device mobility in the sense that calls will "follow" the data network telephone according 
to its SIP URL. This is especially useful if the data network telephone 208a-b or 218a is 
running the DHCP (Dynamic Host Configuration Protocol) so that when the location is 
changed, the IP address is also automatically changed. 

An advantage of the system in FIG. 2 is that once the call is established between 
data network telephones, the data network 206 provides data connectivity for a plurality 
of data communications channels. For example, the data network telephones 208a and 
218a can communication voice signals as voice-over-data packets on a voice-over-data 
channel. The data network telephones 208a and 218a can also communicate graphical 
data (or other PID data) as graphical data packets on a graphic data channel. For 
example, the graphical data may be communicated to and from the PIDs 210a and 220a 
across links 209a and 219a to the data network telephones 208a and 218a, where 
graphical data is packetized and depacketized as part of the process for communicating 
the graphical data packets across the data network 206 and any access networks, such as 
the Ethernet LAN 212 and the cable network 214. 

4. The Data Network Telephones 

The data network telephones 208a-b are preferably telephones that include an 
Ethernet communications interface for connection to an Ethernet port. The Ethernet 
phones in FIG. 2 support the Internet Protocol (IP), using an DP address that is either 
statically configured or obtained by access to a Dynamic Host Configuration Protocol 
(DHCP) server. 

FIG. 3 is a block diagram showing the data network telephone 208a connected to 
the local area network 212 in FIG. 2. The data network telephone 208a in FIG. 3 is 
connected to the network 212 by a network interface 270. The network interface 270 

16 
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may, for example, be a network interface card, and may be in the form of an integrated 
circuit. A bus 248 may be used to connect the network interface 270 with a processor 
240 and a memory 242. Also connected to the processor are user interface circuitry 260 
and three alternative link interfaces to a PID, such as the PID 210a. 

5 A first link interface 248 includes an RS-232 serial connection and associated 

coupling hardware and mechanisms. The first alternative link interface 248 may, for 
example, be a docking cradle for a PDA (Personal Digital Assistant), in which 
information can be transferred between the PDA and the data network telephone 208a. 
The second alternative link interface comprises a first connection 254, such as an RS-232 

10 connection, along with infrared circuitry 250 for converting signals into infrared output 
and for accepting infrared input. An infrared interface 252 may also be included within 
the second alternative link interface. The third alternative link interface comprises a first 
connection 256, such as an RS-232 connection, along with radio- frequency circuitry 258 
for converting signals into radio frequency output and for accepting radio frequency 

15 input A radio frequency interface 259 may also be included as part of the third 
alternative link interface. 

The three alternative link interfaces described above are merely examples, and 
additional means for implementing the link interface between the data network telephone 
208a and the PID 210a may also be used. Although three link interfaces are shown in 

20 FIG. 3, there may be only one such interface in the data network telephone 208a. More 
than one link interface may be included to improve flexibility and to provide redundancy 
in case of failure of one of the link interfaces. 

The user interface circuitry 260 includes hardware and software components that 
access the functions of the handset, display, and keypad to provide user input and output 

25 resources for functions in the processor 240. The user interface circuitry includes a 

display interface 262, a keypad interface 264, an audio output interface 265, and an audio 
input interface 267. 

The audio input interface 267 may receive voice signals from a microphone or 
other audio input device and convert the signals to digital voice information. The 
30 conversion preferably conforms to the G.71 1 ITU Standard. Further processing of the 
digital signal may be performed in the audio input interface 267, such as providing 
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compression (e.g. using G. 723.1 standard) or providing noise reduction, although such 
processing may also be performed in the processor 240. Alternatively, the audio input 
interface 267 may communicate an analog voice signal to the processor 240 for 
conversion to digital information within the processor 240. 
5 The audio output interface 265 receives digital information representing voice 

from the processor 240 and converts the information to audible sound, such as through a 
magnetic speaker. In one embodiment, the audio output interface 265 receives 
information in the form of G.71 1, although other processing such as decompression may 
be performed in the audio output interface 265. Alternatively, the processor 240 may 

10 convert digital information to analog voice signals and communicate the analog voice 
signals to the audio output interface 265. 

The keypad interface 264 and the display interface 262 include well-known 
device interfaces and respective signal processing techniques. The user interface circuitry 
260 may support other hardware and software interfaces. For example, a videophone 

15 implementation might also include a camera and monitor. The data network telephones 
of the present invention are not limited to telephones or videophones - additional user 
interface types, for example, such as the ones needed for computer games, are also 
contemplated as being within the scope of the present invention. In addition, some of the 
features described here, such as the display interface 262, are optional and serve to 

20 enhance the functionality of the first data network telephone 208a. 

The processor 240 may consist of one or more smaller processing units, including, 
for example, a programmable digital signal processing engine. In the preferred 
embodiment, the processor is implemented as a single ASIC (Application Specific 
Integrated Circuit) to improve speed and to economize space. The processor 240 also 

25 may include an operating system, and application and communications software to 

implement the functions of the data network telephone 208a. The operating system may 
be any suitable commercially available embedded or disk-based operating system, or any 
proprietary operating system. 

The processor 240 includes a media engine 241 and a signaling stack 243 to 

30 perform the primary communications and application functions of the data network 
telephone 208a. The purpose of the signaling stack in the exemplary data network 
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telephone 208a is to set up, manage, and tear down a call. During the setup phase, a user 
may use the keypad to enter a user identifier to call. Alternatively, a PID such as PID 
210a may transmit the user identifier of the party across the first link 209a. The signaling 
stack 243 receives the user entry and formats a request message to send to the user 
5 identified by the user identifier to initiate a telephone call. When the request message is 
sent, the location of the user identified by the user identifier is discovered, 
communication parameters, such as the supported voice CODEC types are exchanged, 
and a voice-over-data channel is established. During the management phase, for 
example, other parties may be invited to the call if needed. During the tear down phase, 

10 the call is terminated. 

The signaling protocol used in the data network. telephone 208a in FIG. 3 is the 
SIP protocol. In particular, the signaling stack implements a User Agent Client 244 and a 
User Agent Server 242, in accordance with the SIP protocol. Alternative signaling 
protocols, such as the ITU-T H.323 protocol, MGCP, MEGACO, and others, may also be 

15 used to implement the present invention. 

Once the call is set up, the media engine 241 manages the communication over 
one or more data communications channels using network transport protocols and the 
network interface 270. The media engine 241 sends and receives data packets having a 
data payload for carrying data and an indication of the type of data is being transported. 

20 The media engine 241 in the data network telephones 208a may sample the voice signals 
from the audio input 267 (or receive voice samples from the audio input 267), encode the 
samples, and build data packets on the sending side. On the receiver side, in addition to 
performing the reverse operations, the media engine also typically manages a receiver 
buffer to compensate for network jitter. Similar procedures may be performed for other 

25 types of data, such as graphical data, or for data used in PID applications such as email, 
contacts data, calendar data, other non-voice sound data, interactive game data, etc. 

The media engine 241 may also include hardware and software components for 
performing registration functions 247, voice-over-data functions 249, display data 
functions 251. and keypad output functions 253. The media engine 241 processes data 

30 that is received from the network 212, and data to be sent over the network 241. 
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For data that is received from the network 212, the media engine 241 may 
determine from the type of data in the packet (such as by examining a packet header) 
whether packets contain sampled voice signals or other data types. Packets containing 
sampled voice signals are processed by the voice-over-data function 249. The voice- 
5 over-data function 249 preferably conforms to a protocol for formatting voice signals as 
digital data streams. While any suitable protocol may be used, the media (i.e. the voice 
signal) is preferably transported via the Real Time Protocol (RTP), which itself is carried 
inside of UDP (User Datagram Protocol). RTP is described in H. Schulzrinne et ah, 
"RTP: A Transport Protocol for Real-Time Applications" IETF RFC 1889, Jan. 1996, 
10 which is incorporated herein by reference. UDP is described in J. Postel, "User 

Datagram Protocol," IETF RFC 768, Aug. 1980, and IP is described in J. Postel, ed., 
"Internet Protocol," IETF RFC 791, Sept. 1981, both of which are incorporated by 
reference herein. 

Packets containing data for use in registering the data network telephone 208a 
15 with a network telephony service are processed by the registration function 247. By 
registering the data network telephone 208a, a user may establish with the network 

telephony connection server 150 that calls addressed to the user's user identifier may be 

i 

connected to the data network telephone 208a. Registration may occur when the data 
network telephone 208a sends a request to register to a service provider host, such as the 

20 network telephony connection server 150. The service provider host may respond by 
setting the user's user identifier to correspond to the telephone identifier of the data 
network telephone 208a, and by acknowledging the request with a status message to the 
data network telephone 208a. In one embodiment, a request to register the data network 
telephone 208a to a default user is automatically sent during power-up of the data 

25 network telephone 208a. 

Other features may be added to the registration functions 247, or implemented as 
extensions to the registration functions 247. For example, the first data network 
telephone 208a may be provisioned to provide selected network telephony services by 
establishing a data connection with a service provider, requesting the selected services, 

30 and receiving data that ensures that the services have been successfully provisioned. 

Such services may include, for example, caller identification, call forwarding, voice mail 

20 



WO 01/24503 



PCT/USOO/26650 



and any other services offered by the network telephony service provider to enhance the 
capabilities of the first data network telephone 208a. One advantage of provisioning 
functions is that services may be ordered for temporary use in a manner convenient to the 
user. 

5 Packets containing data for display on a display device of the data network 

telephone 208a are processed by the display data function 25 1. The display data function 
251 may be used for displaying, for example, the names and user identifiers of other 
parties to the call, the status of the telephone call, billing information, and other 
information. 

10 For data to be sent over the data network 212, the media engine 241 formats the 

data as data packets in accordance with a selected protocol. The selected protocol is 
preferably a protocol that is supported by data network telephones that will receive the 
data being transported. 

The voice-over-data function 249 formats voice samples according to the protocol 

15 used by the receiving data network telephone. In one preferred embodiment, the voice 
over data function 249 formats voice samples as RTP packets. The registration function 
247 and the keypad output function 253 may control the transport of data that does not 
represent voice signals. 

The data network telephones 208b and 218a are preferably similar or identical to 

20 the data network telephone 208a. For each of the data network telephones 208a-b and 
218a, many of the features described in FIG. 3 are optional and their inclusion depends 
on the services to be offered. 

5. The Portable Information Devices (PIDs) 

25 FIG. 4 is a block diagram showing the exemplary PID 2 10a that can communicate 

via the link 209a with the data network telephone 208a connected to the LAN 212. The 
PID 210a may be linked to the data network telephone 208a through a link interface 545. 
A bus 580 may be used to connect the point-to-point interface 545 with a processor 540, 
a memory 542, data storage 543, and user interface circuitry 544. 
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The link interface 545 shown in FIG. 4 illustrates three alternative link interfaces 
for establishing a link to a data network telephone, such as the data network telephone 
208a. 

A first link interface 546 includes an RS-232 serial connection and associated 
5 coupling hardware mechanisms. The first alternative link interface 546 may, for 
example, be for coupling with a PDA docking cradle, in which information can be 
transferred between the PDA and the data network telephone 208a. The second 
alternative link interface comprises a first connection 548, such as an RS-232 serial 
connection, along with infrared circuitry 250 for converting signals into infrared output 

10 and for accepting infrared input. An infrared interface 552 may also be included within 
the second alternative link interface. The third alternative link interface comprises a first 
connection 554, such as an RS-232 connection, along with radio-frequency circuitry 556 
for converting signals into radio frequency output and for accepting radio frequency 
input. A radio frequency interface 558 may also be included as part of the third 

15 alternative interface. The radio interface 554/556/558 may be implemented according to 
the Bluetooth specifications, described at www.bluetooth.com. 

The three alternative link interfaces described above are merely examplary, and 
additional means for implementing the interface between the PID 210a and the data 
network telephone 208a may also be utilized. Although three link interfaces are shown in 

20 FIG. 4, there may be only one such interface in the PID 210a. More than one link 

interface may be included to improve flexibility and to provide redundancy in case of 
failure of one of the link interfaces. 

The user interface circuitry 544 includes hardware and software components that 
provide user input and output resources for functions in the processor 540. The user 

25 interface circuitry includes a display output 562, a display input 565, and an additional 
input/output interface 567. 

The display output 562 preferably receives digital information representing 
graphical data from the processor 540 and converts the information to a graphical display, 
such as text and/or images, for display on a display screen, for example. 

30 The display input 565 may receive data inputs, such as graphical data inputs, from 

a user of the PID 210a. The graphical data inputs are preferably entered by the user with 
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a stylus on a pressure-sensitive display screen, and may include text, drawings, or other 
objects that are capable of being graphically presented. 

The additional input/output interface 567 allows the user to enter other types of 
data besides graphical data into the PID 210a, For example, audio data, additional 

5 graphical data, or additional input, such as video camera input for example, may be 

entered through the additional input/output interface 567. The data may also include data 
formatted for operation with particular applications on the PID. For example, email data, 
calendar data, contacts data, database data, spreadsheets, notes, game data, etc. may also 
be entered. Touch-sensitive screen buttons are an exemplary method for a user to enter 

1 0 control data into the PID 2 1 0a. 

The processor 540 may include an operating system, as well as application and 
communication software, to implement the functions of the PID 210a. The operating 
system may be any suitable commercially available operating system, or any proprietary 
operating system. The operating system and software may be stored on data storage 543, 

15 in the memory 542, or the may be embedded in the processor 540. Although the 
processor 540 is shown connected to the data storage 543 through a bus 580, other 
configurations may also be used. Similarly, the memory 542 may be configured other 
than as shown in FIG. 4, and may be embedded within the processor 540. 

The PID 210a is able to send data to and receive data from the data network 

20 telephone 208a across a point-to-point link, such as the point-to-point link 209a shown in 
FIG. 1 . A user enters PID data at the display input 565. The graphical data may be 
processed in the user interface circuitry 544 or it may go directly to the processor 540 or 
the memory 542. The processor 540 may also perform processing functions, such as 
compression. 

25 A PID data application may be used to perform functions that may implement the 

display input, the display output, and the processing functions. For example, a contacts 
application may be used to accept and maintain user input consisting of information 
about the user's personal or business contact. The information, or contacts data is 
provided by the user at the display input 565 with a stylus on the display screen of a 

30 PDA. The contacts application could then display the contacts data through the display 
output 562 to enable the user to see a visual representation of the user input. 
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If the user desires to share the contacts data with a second user on the system 200, 
where the second user is using a second PID such as PID 220a, the contacts data from the 
contacts application can be transmitted through one of the point-to-point interfaces 545, 
allowing the data to be received by the data network telephone 208a. An application in 
5 the data network telephone 208a receives the contacts data across the point-to-point link, 
and the contacts data is prepared for transmission across the data network 206, such as by 
the media engine 241 shown in FIG. 3. Preferably the contacts data is converted to data 
packets and is communicated on a data channel across the LAN 212 through the router 
228 across the data network 206 through the second router 238 across the cable network 

10 2 1 4 to the third data network telephone 2 1 8a. The third data network telephone 218a 
converts the data packets received on the data channel into the contacts data. The 
contacts data is then transmitted across a point-to-point link to the second PID 220a, 
where it may be displayed on a display screen on the PID 220a. The PID 220a may 
contain a similar contacts program as that which was referenced to the PID 210a, 

] 5 allowing the user of the PED 220a to modify the information and transmit the 

modifications back across the point-to-point link to the third data network telephone 218a 
across the cable network 214 through the second router 238 across the data network 206 
through the first router 228 across the LAN 212 to the first data network telephone 208a 
across the point-to-point link and back to the first PID 210a. 

20 The point-to-point link 209a may be a serial bit stream between an application in 

the first PID 210a and an application in the first data network telephone 208a. For 
example, the link 209a could be an infrared link that is implemented with minimal stack 
inteipretation. However, the link 209a between PID 210a and the first data network 
telephone 208a can alternatively be implemented as an infrared link using all or parts of a 

25 specialized protocol, such as the Infrared Data Association (IrDA) protocol stack, where 
data is interpreted through the stack between application-layer processes at each end of 
the link. 

FIG. 5 is a protocol diagram illustrating the layers of the IrDA protocol stack. An 
IrDA stack is implemented at each of the connection endpoints of an IrDA link. For 
30 example, the first PID 210a and the first data network telephone 208a could each 

implement an IrDA protocol stack to enable the link 209a. As a second alternative, two 

24 
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PIDs, such as the first PID 210a and the third PID 21 8a, may each contain an IrDA stack. 
In the second alternative, the communications between the PIDs and the data network 
telephones might take place without the assistance of IrDA. For example, IrDa data from 
the first PID 210a might be transmitted across the link 209a as a serial stream of data to 

5 the first data network telephone 208a, which might treat the IrDA data like any other data 
received from the first PID 210a. The first data network telephone 208a could then 
assemble the IrDA data into packets, such as TCP/IP packets for transport across the 
access and data networks to the third data network telephone 21 8a. The third data 
network telephone 218a may disassemble the packets and forward the IrDA data (without 

10 interpreting the IrDA portions) across the link 219a to the third PID 220a. The third PID 
220a could then process the IrDA information received across the networks. 

The required layers of an IrDA protocol stack are the physical layer 602, the 
IrLAP layer 604, the IRLMP layer 606 and the IAS layer 608. The physical layer 602 
specifies optical characteristics of the link, encoding of data, and framing for various 

15 speeds. The IrLAP (Link Access Protocol) layer 604 establishes the basic reliable 

connection between the two ends of the link. The IrLMP (Link Management Protocol) 
layer 606 multiplexes services and applications on the IrLAP connection. The IAS 
(Information Access Service) layer 608 provides a directory or "yellow pages" of services 
on an IrDA device. 

20 The IrDA protocol also specifies a number of optional protocol layers, these 

protocol layers being TinyTP 610, IrOBEX 612, IrCOMM 614 and IrLAN 616. TinyTP 
(Tiny Transport Protocol) 610 adds per-channel flow control to keep traffic over the 
IrDA link moving smoothly. This important function is required in many cases. IrOBEX 
(Infrared Object Exchange protocol) 612 provides for the easy transfer of files and other 

25 data objects between the IrDA devices at each end of the link. IrCOMM 6 14 is a serial 
and parallel port emulation that enables existing applications that use serial and parallel 
communications to use IrDA without change. IrLAN (Infrared Local Area Network) 616 
enables walk-up infrared LAN access for laptops and other devices. The use of the 
optional layers depends upon the particular application in the IrDA device. The IrDA 

30 protocol stack is defined by such standards documents as 41 IrDA Serial Infrared Physical 
Layer Link Specification", "IrDA 'IrCOMM': Serial and Parallel Port Emulation over IR 



•1 



WO 01/24503 PCT/USOO/26650 

(Wire Replacement)", "IrDA Serial Infrared Link Access Protocol (lrLAP)", "IrDA 
Infrared Link Management Protocol (IrLMP)'\ and "IrDA ; Tiny TP': A Flow-Control 
Mechanism for use with IrLMP" and related specifications published by the IrDA and 
available at http://www.irda,org/standards/specifications.asp and is incorporated by 

5 reference herein. 

The IrDA protocol stack can be implemented at just the PID devices at the 
endpoints with the intermediate phones and networks simply providing a tunnel for the 
media stream attendant to the infrared links. Since PIDs, such as the Palm PDA, already 
have an IrDA stack implemented in them to support their infrared link to other devices 

10 and the benefits of the IrDA stack are already available. By using the layers of the IrDA 
protocol stack, the PID applications and the base applications in the phones can be 
simplified as the IrDA protocol layers take over certain functionalities. For example, the 
IrOBEX layer in each IrDA protocol stack can be used to transfer text and graphics 
object files, such as electronic business cards or whiteboard graphics, end-to-end between 

15 PID devices connected via data connected data network telephones.. 

With the IrDA stack being implemented only in the PIDs and not in the phones, 
only a small level of delay is introduced for stack interpretation by each PID and the 
connection provided is largely transparent to the applications in the PID devices, i.e. little 
or no modification to existing user applications in the PIDs is required. This approach 

20 may be more suitable for delay sensitive applications, such as interactive games 
involving the transfer of data between user applications in each PID. 

It should be noted that the IrDA stack is written for a single infrared point-to- 
point interface and not for an infrared-to-network-to-infrared interface. As a result, the 
timers and retransmission schemes implemented in view of the single infrared point-to- 

25 point interface may not function properly for the extended network interface. 

Alternatively, IrDA stacks can be implemented in the phones as well. By 
implementing IrDA stacks in the phones, the timing of the infrared interface is unaffected 
by a network delay. Also, additional functions and features can be implemented in the 
phones. For example, the phones can implement challenge and authentication where the 

30 phone requires the user, through the PID, to enter a password or other information to 
authenticate an authorized user. Similarly, the PID may also be used to transmit 
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commands to the phone and receive status information via the IrDA stack. The approach 
taken will depend upon the requirements of the design and the particular application. 

6. Providing Telephony and PED Data Exchange 

FIG. 6 is a functional block diagram and protocol stack diagram illustrating an 

5 embodiment of the protocol stacks in the first PID 210a and the first data network 
telephone 208a that support link 209a. In the infrared RS-232 embodiment, the link 
interface circuitry 545 in the first PID 210a provides the physical layer 656, such as that 
specified by the Infrared Data Association (IrDA), that connects via link 209a to the link 
interface circuitry 260 implementing a physical layer 664 in the first data network 

10 telephone 208a. The data link layer 654 in the first PID 210a provides data link control 
for link 209a in transferring data to and from a PED application client 652. Similarly, the 
first data network telephone 208a includes a data link layer 662 and a base application 
server 600 that is configured to synchronize connection and other functions with the PID 
application 652 in the first PID 2 1 0a. 

15 When PID 2 1 0a is activated, either through power-up or through a user input at 

the user interface 650, the synchronization application client 652 in the PED 210a may 
send the user's SIP URL across the link 209a to the first data network telephone 208a, 
where it is received by the synchronization application server 600. The synchronization 
application server 600 sends the SIP URL received from the PID 210a across connection 

20 2 30 and the Ethernet LAN 212 through connection 243 to the network telephony 

connection server 150. The network telephony connection server 1 50 may store the SIP 
URL and the IP address of the associated data network telephone 208a in the SIP 
database 152 so that the SIP URL is listed as being resident at the EP address of the data 
network telephone 208a. (If the network telephony connection server 150 uses a location 

25 server for registration/location tasks, the registration information might instead be stored 
with such a location server). SQL (Structured Query Language) is preferred for querying 
the database. Once the PID 210a is registered with the network telephony connection 
server 150, calls to the SIP URL for PID 210a (or the user of the PID 210a) will be 
directed to the data network telephone 208a. 
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FIG. 7 is a functional block and protocol stack diagram illustrating an 
embodiment of the present invention where a SIP connection is established from the first 
data network phone 208a to the third data network phone 218a through network 
connection 230. first access network 212, data network 206, second access network 214 
5 and network connection 236. The routers 228 and 238, and associated connections 232a- 
b and 234a-b, arc not shown to simplify the block diagram representation. 

The diagram of FIG. 7shows how PID data from a PID application can be passed 
from one PID to another PID in one aspect of the present invention. The PID application 
652 in PID 210a is configured to send PID data input through the user interface 650 
10 through link 209a to base application 660 in the first data network phone 208a. In this 
embodiment, base application 660 is configured to define data channels for transport to 
the third data network telephone 21 8a. 

Multiple data channels in SIP may be defined through the Session Description 
Protocol described in RFC 2327, herein incorporated by reference. Included in a SIP 
15 INVITE request for a connection are options for the requested connection that describe 
the number and type of media streams. Each media stream is described by a "m=" line in 
the INVITE request. For example, a request for a connection that includes an audio 
stream and a bidirectional video stream using H.261 might look like this: 

20 v=0 

o=alice 2890844526 2890844526 IN IP4 host.anywhere.com 

c=IN EP4 host.anywhere.com 

m=audio 49170 RTP/AVP 0 

a=rtpmap:0 PCMU/8000 
25 m=video 5 1372 RTP/AVP 3 1 

a=rtpmap:31 H26 1/90000 

TABLE 1. 

If the called device includes functionality to receive the connection as described 
30 in Table 1, then the called device will respond to the INVITE request with a 200 OK 
response that includes the same option values. If the called device or party is unable or 
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unwilling to receive such a connection, then it will respond with alternative option values 
for the connection. See RFC 2543 for further details regarding the negotiation of 
connection parameters in SIP. 

In FIG. 7 ? a first data channel for voice data and a second data channel for PID 
5 data have been negotiated by the base applications 660 in the first data network telephone 
208a and the base application 674 in the second data network telephone 21 8a. The base 
applications 660 and 674 transfer voice data between the AUDIO applications, such as 
applications including G.71 1 encoders, in each phone via the first data channel. The base 
application 660 in phone 208a is also configured to send the PID data received via link 

10 209a from PID 210a to the base application 674 in phone 218a via the second data 
channel. The base application in phone 218a is configured to forward the PID data 
received via the second data channel to PID 220a via link 219a. The PID application 688 
in PID 220a then outputs the user data received from phone 218a to the user interface 686 
for output to the user of PID 220a. Depending on the particular application being used in 

15 the PID 220a, the PED data may also be used in application functions. 

The PID data in FIG, 7 can take a variety of forms. For example, the PID data 
can be a text file containing information about the user of PID 210a, such as an electronic 
business card. The PID data can also be drawing data generated by graphical 
applications in the PEDs 210a and 220a whereby a user drawing on a touchscreen of the 

20 user interface 650 in PED 210a generates corresponding PID data that is transmitted via 
the second data channel to PID 220a for display on the user interface 686 of PID 220a. 
The media description for the media stream can be defined during connection setup to 
establish a connection appropriate to the type of data being transferred. These examples 
represent just a few of the applications for this aspect of the present invention and should 

25 not be viewed as limiting the present invention. 

In one embodiment, RTP data packets for two or more types of data are 
exchanged between the first data network telephone 208a and the second data network 
telephone 218a according to one of three possible methods. In the first method, one RTP 
data channel (or RTP stream) on UDP carries data packets in which both data types are 

30 present in a single split packets. Each such split packet contains (1) a source port number 
and a destination port number in the UDP portion, and (2) a special payload sequentially 
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including each of the data types in the RTP portion. The special pay load type can be 
defined in the SDP described with reference to FIG. 6. Other information is also 
contained in each packet as well. In the second method for transmitting two or more data 
types, a separate RTP over UDP data channel is created for each of the different data 
5 types, and the RTP header indicates which type of data is contained in each packet. For 
example, voice data coded as G.71 1 might be assigned a pay load type code of 0, while 
PBD data is assigned a payload type code of 1 90. In the third method for transmitting two 
or more data types, a single RTP/UDP data channel (RTP/UDP stream) is created that 
contains data packets of two or more different types. In this method, the data types are 
10 identified in a payload type field in the RTP header of each packet, enabling an 

underlying application to identify which data packets are voice data packets and which 
data packets are PID data packets, for example. 

C. Providing PID Data Exchange Concurrent with Voice Services 

FIGs. 8-10 are block diagrams illustrating exemplary embodiments of the present 
15 invention. Various elements within FIGs. 8-10 are similar to or identical to elements in 
FIG. 2, and accordingly share common reference numerals. Although only two PEDs 
210a and 220a are shown in FIGs. 8-10, this is not intended to be limiting. More than 
two PIDs may be involved in a session. The quantity of PIDs is limited by the bandwidth 
of the access and data networks, and the characteristics of the data to be utilized in the 
20 shared environment. To communicate with additional PEDs, additional data channels are 
created by the data network telephones. 

1 . Non-Continuous PED Data Transmission with Separate Data Channels for 
PED Data and Voice Data 

FIG. 8 shows an exemplary embodiment of the present invention in which 
25 separate data channels are used for PID data and voice data, and in which PID data may 
be transmitted on a non-continuous basis. The first PID 210a includes a display screen 
702, a stylus 700 that a user can use to enter PID data into the first PID 210a, and an 
SYNC button 718. 
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The display screen 702 is shown as a pressure-sensitive display screen in which 
the stylus 700 can be used to enter PID data 714 into the first PID 210a. In the example 
shown in FIG. 8, the PID data 714 consists of a drawing 704 that is a tic/tac/toe game. 
The stylus is being used to draw a modification 706 (an "O") as part of a tic/tac/toe game 
5 with a user of the second PID 220a. The second PID 220a also contains a display screen 
708, a SYNC button 720, and a stylus, which is not shown in FIG. 8. The display screen 
708 on the second PID 220a also displays the drawing of the tic/tac/toe game between the 
user of the first PID 210a and the user of the second PID 220a. 

In the embodiment shown in FIG. 8, the modification 706 to the drawing 704 is 

10 not transmitted continuously as the modification is being made by the stylus 700. 

Instead, the PID data 714, including the modification 706, is only transmitted when the 
user of the first PID 210a synchronizes the first PID 210a with the first data network 
telephone 208a. For example, the user may synchronize the first PID 210a by pressing 
the SYNC button 718 to cause the PID data 714 to be transmitted across the link 209a to 

15 the first data network telephone 208a. As a second example, a predefined stylus-stroke 
may be executed by the user of the stylus 700 to the display screen 702 to cause the PED 
data 714 to be transmitted to the first data network telephone 208a. An example of a 
stylus-stroke is a long stroke from the bottom to the top of the display screen 702. In an 
alternative aspect of this embodiment of the invention, a PID application 652, such as a 

20 drawing application, may periodically transmit the PID data 7 14 at predefined time 
intervals to the first data network telephone 208a. If the predefined time intervals are 
short, the transmission of the PID data 714 will approach the appearance of a continuous 
transmission of the PID data from the first PID 210a to the first data network telephone 
208a. 

25 When the first data network telephone 208a receives the PID data 71 4, an 

application within the first data network telephone 208a will place the PID data 714 into 
PID data packets for transmission to the second data network telephone 218a across the 
access and data networks 212, 206 and 214 (and any associated connections and routers). 
The second data network telephone 2 1 8a then removes the received PID data 716, the 

30 PID data packets and transmits the PED data 716 across the second link 219a to the 
second PID 220a for display on the display screen 708. The PID data packets 
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communicated between the first and second data network telephones 208a and 218a are 
on a PID data channel 724. In the exemplary embodiment of FIG. 8, the PID data 
channel 724 is the second of two data channels. A voice-over-data channel 722 is the 
first data channel between the first data network telephone 208a and the second data 
5 network telephone 21 8a. The voice-over-data channel 722 carries voice-over-data 
packets assembled by the data network telephones 208a and 218a that contain voice 
signals 726 and 728 spoken by the users of the PIDs 210a and 220a. As a result of the 
dual data channels, the users of the PIDs 210a and 220a may participate in a conversation 
while they are playing their tic/tac/toe game in the example shown. 

10 One advantage of the examples described herein of the present invention is that 

the PID data is not limited to graphical or image data. The type of data transmitted 
conforms to the application being used. For example, in the example described above 
with reference to FIG. 8, the tic-tac-toe game may be played with a tic-tac-toe game 
application as opposed to simply a drawing program. The tic-tac-toe game may 

15 determine the winner and draw the line through the winning row or column. The game 
may also keep a record of games won v. games lost for each user. 

The PID data channel 724 is shown as being transported by using TCP over IP. 
This is merely one method for transporting the graphical data packets. Other transport 
protocols may also be used. A TCP/IP implementation may be particularly advantageous 

20 for non-continuous graphical data transmission embodiments of the present invention. 
This is due to TCP's congestion avoidance mechanisms. Therefore, if PID data packets 
are being lost (which may be the result of a congested network), TCP may reduce the 
transmission packet size (the window) to alleviate some of the congestion and to provide 
better performance. By reducing the quantity of PID data on such a congested network, 

25 the other network traffic (such as the voice data) should also experience better 
performance (fewer lost packets, etc.), which can be important for voice data 
applications. The voice-over-data channel 722 is shown as an RTP/UDP/EP channel. 
Such a channel will be described in more detail with reference to FIG. 9. 

Note that with the non-continuous PID data transmission embodiment of the 

30 present invention, when a user inputs PID data into the first PID 2 10a, the PID data does 
not appear on the display screen of the second PID 220a until the PID data 714 is 
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transmitted to the first data network telephone 208a. Therefore, in FIG. 8, the user has 
begun making a modification 706 to the drawing 704, but has not synchronized the PID 
210a with the first data network telephone 208a. As a result, the drawing 710 on the 
display screen 708 of the second PID 220a does not yet contain the modification 706 (see 

5 the open box 734). When the user of the first PID 210a has completed the modification 
706 and has synchronized the PID 21 Oa with the first data network telephone 208a, the 
PID data will be transmitted through the data network telephone 208a through the access 
and data networks 212, 206 and 214, through the second data network telephone 218a 
and to the second PID 220a in the box 734 on the display screen 708 of the second PID 

10 220a. 

2. Continuous PID Data Transmission with Separate Data Channels for PID 
Data and Voice Data 

FIG. 9 is a block diagram showing a second exemplary embodiment of the present 
invention. This embodiment differs from the embodiment illustrated by the example of 

15 FIG. 8 because PID data is continuously transmitted from the PID 210a across the first 
link 209a to the first data network telephone 208a, where it is packetized and transported 
across the access and data networks to the second data network telephone 218a. At the 
second data network telephone 218a, the PID data packets are disassembled, and PED 
data 716 is sent to the second PID 220a for display on the display screen 708 of the 

20 second PID 220a. Therefore, the user of the second PID 220a is able to see the 

modification 712 as the modification 706 is being drawn by the user using the stylus 700 
on the first PID 210a, although there may be some network delay and delay due to the 
packet assembly and disassembly operations. 

To accomplish the continuous transmission of PID data 714 from the first PID 

25 2 1 0a to the first network communication device 208a, the PID application 652 

continuously transmits PID data, such as pixel information, to the data network telephone 
208a as the PID data is received by the PID 2 10a through the user interface 650. The 
base application 660 in the first data network telephone 208a receives the PID data 
transmitted by the PED 210a and converts the PID data into PID data packets for 

30 transmission on a PID data channel 730. The PID data channel 730 is shown as being 
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transported across the access and data network 212, 206, and 214 using the RTP protocol 
over UDP which is on top of IP. Other protocol implementations may also be used, but 
the continuous nature of the PID data transmission in the example of FIG. 9 lends itself 
well to the use of RTP/UDP/IP. Similarly, the voice-over-data channel 722 is also shown 
5 as an RTP/UDP/IP channel, to take advantage of the real-time properties of voice data 
726 and 728. 

3. Continuous PID data Transmission with a Mixed-Media Data Channel for 
PED data and Voice Data 

FIG. 10 is a block diagram showing a third exemplary embodiment for providing 

10 PID data exchange concurrently with voice services in which PID data 714 is 

continuously transmitted from the first PID 210a to the first data network telephone 208a 
for transport across the access and data networks 212, 206, and 214 to the second data 
network telephone 218a, where PID data 716 is then transmitted to the second PID 220a 
for display on the display screen 708 of the second PID 220a. As in the exemplary 

15 embodiment shown in FIG. 9, a graphical modification 706 on the first PID 210a is 

continuously transmitted as the modification is being made so that similar representation 
of the modification 712 appears on the second display screen 708 on the second PID 
220a, after processing and propagation delays. 

The main difference between the embodiment of FIG. 9 and the embodiment of 

20 FIG. 10 is that in FIG. 10 PID data 714 and the voice data 726 are transported across a 
single data channel. The first data network telephone 208a receives the voice data 726 
and the PID data 209a through the user interface circuitry 260 and one of the link 
interfaces, such as the infrared link interface 252/250/254 as shown in FIG. 3. The 
processor 240 (or a portion of the processor 240, such as media engine 241) assembles a 

25 data packet, such as an RTP packet, in which the payload consists of a portion that 

represents the voice data 726 and a second portion that represents the PID data 714. The 
header of the RTP packet contains a "payload type" field, which is a 7-bit field 
identifying the format of the RTP payload and which determines the payload's 
interpretation by an application. RTP allows a profile to specify a default static mapping 

30 of payload type codes to payload formats. Additional payload type codes may be defined 
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dynamically through non-RTP means. All that is required is that the receiving device, 
such as the second data network telephone 218a, be able to disassemble the mixed media 
packet into voice data 728 and PED data 716. Although RTP has been described for 
implementing the mixed media, data packets, other similar protocols may also be used. 

While the invention has been described in conjunction with presently preferred 
embodiments of the invention, persons of skill in the art will appreciate that variations 
may be made without departure from the scope and spirit of the invention. For example, 
the access networks shown in FIG. 2 may comprise any other suitable type of local area 
network or service infrastructure. 

In addition, protocols of various types are referenced throughout. While preferred 
and alternative embodiments may implement selected protocols, any suitable replacement 
protocol not mentioned, or any function not part of a protocol used to replace a 
corresponding function from a protocol may be implemented without departing from the 
scope of the invention. 

This true scope and spirit is defined by the appended claims, interpreted in light of 
the foregoing. 
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WE CLAIM: 

1 . A system for exchanging data on a data network telephony system comprising: 

a data network to provide data connectivity for a plurality of data communications 
channels using data transport protocols; 

first and second data network telephones connected to the data network, each data 
network telephone operable to communicate a voice signal as voice-over-data packets on 
a voice-over-data channel, the voice over data channel being one of the plurality of data 
communications channels on the data network, the data network telephones operable to 
convert voice-over-data packets communicated on the voice-over-data channel to voice 
signals; 

a first portable information device comprising a first graphical user interface and a 
first data network telephone interface, the first graphical user interface operable to accept 
and display PID data, the first data network telephone interface operable to communicate 
PID data to and from the first data network telephone; and 

a second portable information device comprising a second graphical user interface 
and a second data network telephone interface, the second graphical user interface 
operable to accept and display PID data, the second data network telephone interface 
operable to communicate PID data to and from the second data network telephone, 

wherein the first PID communicates PID data to the first data network telephone, 
the first data network telephone communicates the PID data to the second data network 
telephone, and the second data network telephone communicates the PED data to the 
second PID.. 

2. The system of Claim 1 wherein: 

at least a first and second user communicate on the voice-over-data 
channel and the PED data channel, each user identified by a user identifier that 
includes a unique sequence of alpha numeric elements 

3. The system of Claim 2 wherein each data network telephone includes a device 

identifier that corresponds to the user identifier. 
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4. The system of Claim 3 wherein the device identifiers include Internet Protocol 
(IP) addresses. 

5. The system of Claim 3 wherein the user identifiers include Session Initiation 
Protocol (SIP) addresses. 

6. The system of Claim 3 wherein the user identifiers include E.164 telephone 
numbers. 

7. The system of Claim 1 further comprising: 

a network telephony user database connected to the data network to store a 
user identifier and a telephone identifier corresponding to the user identifier for 
each of a plurality of users, wherein: 

the user identifier includes a first sequence of alphanumeric 
elements that identify a corresponding user; 

the telephone identifier includes a second sequence of 
alphanumeric elements that identifies a corresponding data 
network telephone; and 
a network telephony connection server operable to receive a request 
message from the first data network telephone to initiate the voice over data 
channel and the PID data channel with the second data network telephone, and to 
send a response message in response to the request message, 

8. The system of Claim 7, wherein the response and request messages are 
communicated by the network telephony connection server in accordance with the 
Session Initiation Protocol (SIP). 

9. The system of Claim 7, wherein the response and request messages are 
communicated by the network telephony connection server in accordance with the H.323 
Protocol. 
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1 0. The system of Claim 7 wherein the response and request messages are 
communicated by the network telephony connection server in accordance with the 
MGCP protocol. 

1 1 . The system of Claim 7 wherein the response and request messages are 
communicated by the network telephony connection server in accordance with the 
MEGACO protocol. 

12. The system of Claim 7 wherein: 

the request message includes a callee user identifier; and 
wherein the network telephony connection server determines the telephone 
identifier for the callee user identifier and includes the telephone identifier in the 
5 response message. 

13. The system of Claim 7 wherein: 

the request message includes a callee user identifier; and 
wherein the network telephony connection server determines the telephone 
identifier for the callee identified in the callee user identifier and sends the 
5 response message to the callee at the telephone identifier. 

14. A method for transferring data between first and second personal information 
devices (PIDs) across a network, the method comprising the steps of: 

providing a first communication link between the first PED and a first network 
communication device coupled to the network; 

providing a second communication link between the second PID and a second network 
communication device coupled to the network; 

establishing a connection through the network between the first and second network 
communication devices, where the connection includes at least one media stream for transfer of 
data between the first and second PIDs; 

selecting a data object in the first PID; 
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transmitting the selected data object from the first PID to the first network 
communication device over the first communication link; 

transferring the selected data object from the first network communication device over 
the media stream to the second network communication device; and 

transmitting the selected data object from the second network communication device to 
the second PID over the second communication link. 

15. The method of claim 14, the method further including the step of providing a 
location server accessible via the network and where the step of establishing a connection 
through the network further comprises: 

sending a connection request from the first PID to the first network communication 
device, where the connection request includes a user identifier value corresponding to the second 
PID; 

responsive to the connection request, sending a query including the user identifier value 
to the location server, 

searching in the location server for an entry matching the user identifier value, where the 
matching entry includes a network address value corresponding to the second network 
communication device; 

when the matching entry is found, sending a response message with the network address 
value corresponding to the second network communication device from the location server to the 
first network communication device; and 

setting up the connection from the first network communication device to the second 
network communication device using the network address value corresponding to the second 
network communication device. 

16. The method of claim 15, the method further including the steps of: 

sending a registration request including the user identifier value from the second PID to 
the second network communication device via the second communication link; 

responsive to the registration request, sending a registration update message including the 
user identifier value from the second network communication device to the location server via 
the network; and 



39 



WO 01/24503 PCT/USOO/26650 

responsive to the registration update message, storing the matching entry having the user 
identifier value and the network address of the second network device in the location server. 

17. The method of claim 16, where the location server further comprises a redirect 
server according to an Session Initiation Protocol (SIP). 

18. The method of claim 14, the method farther including the step of providing a 
location server accessible via the network and where the step of establishing a connection 
through the network further comprises: 

sending a connection request from the first PID to the first network communication 
device, where the connection request includes a user identifier value corresponding to the second 
PID; 

responsive to the connection request, sending a query including the user identifier value 
to the location server; 

searching in the location server for an entry matching the user identifier value, where the 
matching entry includes a network address value corresponding to the second network 
communication device; 

when the matching entry is found, sending a connection set-up message to the network 
address value corresponding to the second network communication device from the location 
server, and 

setting up the connection between the first network communication device to the second 
network communication device responsive to the connection set-up message. 

19. The method of claim 18, the method further including the steps of: 

sending a registration request including the user identifier value from the second PID to 
the second network communication device via the second communication link; 

responsive to the registration request, sending a registration update message including the 
user identifier value from the second network communication device to the location server via 
the network; and 

responsive to the registration update message, storing the matching entry having the user 
identifier value and the network address of the second network device in the location server. 
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20. The method of claim 19, where the location server further comprises a proxy 
server according to an Session Initiation Protocol (SIP). 

21 . The method of claim 19, including the step of defining the connection through the 
network between the first and second network devices using a Session Description Protocol 
(SDP). 

22. The method of claim 14, where the first and second communication links are 
infrared links. 

23. The method of claim 22, further including the steps of: 
providing a predetermined protocol stack in the first and second PIDs; and 
transferring the selected data object between peer layers of the predetermined protocol 

stack. 

24. A data network telephone for transferring data between a personal information 
device (PID) and a network, the device comprising: 

means for communicating with the PED; 
means for communicating with the network; 

means for setting up a connection to another network communication device responsive 
to receiving a connection request command from the PID through the PID communication 
means, where the connection request command includes a user identifier value corresponding to 
the another network communication device and where the connection is defined to have at least 
one media stream for transferring data from the PID to another PID; and 

means for receiving a selected data object from the PID and transmitting the selected data 
object through the media stream of the connection to the another network communication device. 

25. The network communication device of claim 24, where the means for setting up a 
connection to another network communication device includes: 

means for sending a query for the user identifier value to a location server; 
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means for receiving a response from the location server, where the response includes a 
network address for the another network communication device; and 

means for connecting to the another network communication device using the network 
address from the response. 

26. The network communication device of claim 25, where the means for connecting 
to the another network communication device further comprises Session Initiation Protocol (SIP) 
means for setting up the connection. 

27. The network communication device of claim 26, where the means for connecting 
to the another network communication device includes means for defining the one media stream 
using a Session Description Protocol (SDP). 

28. The network communication device of claim 25, further including means for 
receiving a registration request having another user identifier value from the P1D and, responsive 
thereto, sending a registration update message, having the another user identifier value and 
another network address corresponding to the network communications device, to the location 
server. 

29. The network communication device of claim 24 further including protocol means 
for communicating with a peer protocol means in the another PID. 

30. The network communication device of claim 29, where the means for 
communicating with the PID further comprises an infrared communications link and where the 

protocol means further comprises an IrDA protocol stack. 

** 

3 1 . The network communication device of claim 24, where the means for setting up a 
connection to another network communication device is further configured to set up another 
media stream for transferring data between the network communication device and the another 
network communication device simultaneous to the transfer of data between the PID and the 
another PID through the one media stream. 
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32. A system for transferring data between personal information devices (PIDs) 
across a network, the system comprising: 

a first personal information device (PDD) having a communication port, where the first 
PDD is configured to transmit a connection request having a user identifier value through the 
communication port and where the first PED is configured to transmit a selected data object via 
the communication port; 

a first network communication device having a communication port and a network 
interface connection coupled to the network, where the first network device is configured to 
receive the connection request and establish a connection with a second network communication 
device corresponding to the user identifier value from the connection request, where the 
connection includes a first media stream for transferring data between PIDs, and where the first 
network communication device is further configured to receive the selected data object via the 
communication port of the first network device and send the selected data object through the first 
media stream. 

33. The system of claim 32, where: 

the first network communication device is further configured to transmit a query message 
onto the network that includes the user identification value from the connection request and the 
first network communication device is configured to receive a response message through the 
network that includes a network address corresponding to the user identification value and 
establish the connection using the network address; and 

the system further includes a location server having a network connection coupled to the 
network and a data store for storing entries that relate user identifier values to network addresses, 
where the location server is configured to receive the query message from the first network 
communication device that includes the user identifier value and, responsive thereto, search the 
data store for an entry corresponding to the user identifier value and, when a corresponding entry 
is found, send a response over the network to the first network communication device that 
includes the network address value from the corresponding entry. 
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34. The system of claim 33, where: 

the user identifier value is a Session Initiation Protocol (SIP) Universal Resource Locator 

(URL); 

the location server is a SIP location server operating in redirect mode; and 
the first network device is configured to define the first media stream using a Session 
Definition Protocol (SDP). 

35. The system of claim 32, where: 

the first network communication device is further configured to transmit a query message 
onto the network that includes the user identification value from the connection request; and 

the system further includes a location server having a network connection coupled to the 
network and a data store for storing entries that relate user identifier values to network addresses, 
where the location server is configured to receive the query message from the first network 
communication device that includes the user identifier value and, responsive thereto, search the 
data store for an entry corresponding to the user identifier value and, when a corresponding entry 
is found, establish the connection between the first network communication device and a 
network communication device corresponding to the network address value from the 
corresponding entry. 

36. The system of claim 33, where: 

the user identifier value is a Session Initiation Protocol (SIP) Universal Resource Locator 

(URL); 

the location server is a SIP location server operating in proxy mode; and 
the first network device is configured to define the first media stream using a Session 
Definition Protocol (SDP). 

37. The system of claim 32, where the system includes a second P1D coupled to the 
second network communications device, and where the first network 
communications device is further configured to establish a second media stream 
for transferring data between the first and second network communications 
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devices while data is simultaneously transferring between the first and second 
PIDs via the first media stream. 
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